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SUMMARY 


An  algorithm  is  given  for  the  numerical  solution  of  the 
"mixed  Integer"  linear  programming  problem,  the  problem  of 
maximizing  a  linear  form  in  finitely  many  variables  constrained 
both  by  linear  inequalities  and  the  requirement  that  a  proper 
subset  of  the  variables  assume  only  integral  values.  Hie 
algorithm  is  an  extension  of  the  cutting  plane  technique  for 
the  solution  of  the  "pure  Integer"  problem. 


P—1885 

2 


For  the  sake  of  a  more  uniform  notation  we  will  rewrite  this  aa 


(2) 


*1.0  + 


J«n 
2  a 
J-l 


i  «  0,  . . . ,  m-m. 


where  the  xi  now  are  all  the  variables  and  the  a^  ^  are  all 
the  coefficients. 

The  usual*  linear  programming  problem  is  solved  by  apply¬ 
ing  0.  B.  Dantzig's  simplex  method.  In  this  method  a  series 
of  "pivot  steps,"  "Gaussian  eliminations,"  "changes  of  basis," 
or  "changes  to  different  sets  of  nonbjtsic  variables"  bring  the 
equations  (2)  into  a  form  in  which,  denoting  the  new  coeffi¬ 
cients  in  the  equations  by  primes. 


(I)  *i,o>0 

and 

(II)  a^j  ^  0 


1  •  1 i  •  •  • ,  m+n 

J  *  1 ,  n. 


The  first  condition  is  the  condition  that  in  the  "trial  solution" 
obtained  by  putting  all  the  nonba.tlc  variables  equal  to  zero, 
the  values  that  result  for  all  the  variables  are  nonnegative. 

The  second  condition  makes  certain  that  the  objective  function 
is  in  fact  maximal  when  the  variables  are  given  the  values  they 
attain  in  this  trial  solution.  The  solution  obtained  i3  of  course 


The  usual  method  terminates  when  conditions  (ii)  first 
hold.  It  is  necessary  here  that  the  pivoting  continue  until 
all  columns  J  >  0  become  lexicographically  positive.  The 
procedure  for  doing  this  is  described  in  [1]. 
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x,  «  a,  ^ 

1  1  ,o 


i  -  0,  .  . . ,  m+n. 


This  solution  may  very  well  not  satisfy  the  integer  requirement, 
i.e.,  some  x^  that  is  required  to  be  an  integer  is  assigned  the 

i 

noninteger  value  a,  . 

;  A  *  ° 

If  this  occurs  we  will  be  able  to  deduce  a  new  inequality 
that  will  be  satisfied  by  any  integer  solution,  i.e.,  by  any 
solution  having  Integers  where  they  are  required,  but  will  not 
be  satisfied  by  the  current  trial  solution. 

Then,  Just  as  in  [1]  and  [2],  this  new  Inequality  will 
be  added  to  the  original  set  of  inequalities,  and  the  new  set 
then  remaximised  by  the  simplex  method.  This  remaximization 
Is  usually  quite  rapid  as  adding  the  new  inequality  maintains 
dual  feasibility,  and  introduces  Just  the  one  unsatisfied 
inequality. 

If  the  new  maximum  solution  still  contains  integer  vari¬ 
ables  which  are  assigned  noninteger  values  the  process  is 
repeated. 

To  deduce  this  new  Inequality  we  make  use  of  the  equation 


al,o  +  Z  al,J(“V. 


where  the  x.  is  an  integer  variable,  a.  Is  noninteger,  and 

1  1  j  O  • 

I 

the  tj  are  the  current  set  of  nonbasic  variables.  Since  a^  Q 
Is  noninteger  it  can  be  written  uniquely  as  the  sum  of  an 

i  ii 

integer  n,  and  a  fractional  part  f,  ,  0  <  f,  •  <  1. 

1  f  O  1  |  O  i  j  u 
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We  now  imagine  that  we  have  an  integer  solution  to  the 

ii 

problem  and  use  x^,  tj  to  denote  the  values  given  to  the  vari— 
*  / 

ables  in  (3)  by  thi3  solution.  Hence 


i 

and  using  a  sr  b  to  mean  a  and  b  differ  by  an  Integer  (equiv— 

?  . 

alence  modulo  1),  we  have,  since  x^  «  0  and  a^^  Q  «  f^  Q, 

C)  E  H.j4]  e  fi,o- 

t. 

We  will  group  the  constants  on  the  left  in  (h)  according 
to  their  sign.  Let  S  be  the  set  of  indices  J  for  which  a^  j  >  0, 

—  i 

and  S  the  set  for  which  a1  ^  <  0.  Then 


ii  iii 

2  a  t .  +  2  a,  .t  -  f  , 
jeS+  J  JeS  J  l>o 


There  are  now  two  possibilities  to  consider.  Either  the 
expression  on  the  left  is  (i)  nonnegative,  or  (ii)  negative. 

Case  (i).  Since  the  left  side  is  nonnegative  and  equiv— 

i  i  i 

alent  to  f  ,  its  value  can  only  be  fQ,  or  1  +  fQ,  or  2  +  fQ,  etc, 


h’°  1  jcS+  +  jes-  -  JeS+ 


Hence 
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Case  (11).  If  the  right-hand  aide  la  negative  arid  equlv— 

i 

alent  to  f,  It  can  only  be  f  —  1,  f  —  2,  etc.  So  In  every 

1  I  U  U  U 

caae 


i  i 


f  4  ■  0  1  ^  ^  J.  4  ^  4  ^  ®-4  «t.  Z  a.  .  t., 

1'°  US+  1<J  J  US  1’J  J  “  JeJf  x-3  3 


or,  multiplying  by  —  ^  ^1  —  f^  ( 


f  ^  <  Z  _  t — t  (— *4  * 

JeS  1  -  f .  .  1,J  J 

1  |  o 

Now  either  (1)  holda  or  (11)  holda  so  always 


i  i 


(6) 


f  4  n  ^  .  8-4  j  t  .  -f  2  

1,0  JeS+  X'J  J  JeS  1  -  f 


±2. £ 


1,0 


since  the  right  side  la  the  sum  of  two  nonnegative  numbers, 

i 

one  of  which  la  >  f.  . 

—  1*0 

This  Inequality  then  la  satisfied  by  any  Integer  solution 
but  not  by  the  present  trial  solution  since  substituting 
tj  -  0  for  all  J  Into  (6),  makes  the  right-hand  aide  0. 

Of  course  the  Inequality  (6)  can  be  rewritten  a3  an  equation 
by  introducing  a  nonnegative  slack  a.  Then  (6)  becomes 


i 


^  +  ai  i  (" 
J  eS+  1,J 


,fcj)  ' 


Z 

JeS" 


1  -  f 


i,o 


3 
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In  obtaining  (6)  we  have  used  only  the  fact  that  was 
required  to  be  an  integer.  If  some  of  the  nonbaslc  variables 
tj  are  also  integer  variables,  the  inequality  (6)  can  be 
improved  in  a  manner  entirely  analogous  to  the  reduction 
that  is  always  possible  in  the  strictly  integer  problem,  Hie 
improvement  will  take  the  form  of  a  decrease  in  the  coefficients 
on  the  right  in  the  resulting  Inequality  (6).  It  is  clear  that 

i 

for  fixed  f.  the  smaller  these  coefficients,  the  stronger 

^  9  O 

the  inequality. 

Let  us  suppose  then  that  some  t.  is  required  to  be 

Jo  , 

integer  and  hence  is  assigned  an  integer  value  t.  in  (5)* 

. 

Changing  a.  .  by  an  integer  amount  then  changes  the  left 
'  Jo 

side  of  (5)  by  an  integer,  and  hence  preserves  the  equivalence. 

•  * 

Thus  we  may  replace  a.  .  by  any  new  value  a  «  a.  .  and 

1,Jo  1,Jo 

proceed  Just  as  before  to  deduce  an  inequality  like  (6). 

* 

If  a  >0,  the  coefficient  of  t,  in  the  resulting  in— 

*  #  i  i  * 

equality  is  simply  a  .  If  a  is  <  0,  it  is  — f.  /  (1  —  f.  )a  . 

1 1 0  X  f  o 

*  #  •  It 

Among  a  >  0,  a  -  f .  the  fractional  part  of  a.  .  clearly 
“  J0  1>Jo 

gives  the  smallest  coefficient  to  t.  In  the  resulting  ii>- 

*^o 

# 

equality.  (This  may  even  be  0.)  Among  a  <  0,  the  smallest 

-  1,  and  Is 

i 


*  * 

coefficient  Is  obtained  from  a  -  f ^ ^ 


(T) 


1  -  f 


i,o 


(i  -  ,  )• 


"By  the  fractional  pait  of  both  positive  and  negative 


numbers  a^  j  we  will  mean  the  nonnegative  fraction  f^  j  <  1  such 
that  a^  j 


n^  j  +  f^  j  with  n^  j  integer. 
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To  obtain  the  smallest  possible  coefficient .we  choose  the 

i 

smaller  of  f,  .  and  (7)  which,  because  an  expression  of  the 
J-»J0 

form  x/1  —  x  Increases  monotonically  with  x  is  seen  to  be 

iii 

f.  .  if  f.  .  <  f,  n 

i'Jo  'Jo  “  1,0 


— A°- » —  fl  -  f,  ,  )  if  f '  >  f '  . 

1  _  f  \  °'° 

1,0 


It  follows  that  the  strongest  inequality  is  obtained  by 
a  simple  two— stage  process.  (1)  First  replace  coefficients 
of  integer  variables  by  their  fractional  parts  If  these  are 
less  than  f^  Q,  or  by  the  fractional  parts  less  1  if  they  are 
greater  than  f.  .  (11)  Then  deduce  the  Inequality  (6)  as 
before.  The  final  result  obtained  from  the  equation 


X1  -  ai,0  +  s  ai,jH\j> 

by  this  precedure  is  the  inequality  represented  by  the  equation 

(8)  •  s  — -  2 

* 

where  the  j,  all  nonnegative,  are  given  by  the  following 
formulae : 
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iL» 


1  -  f 


i,J 


i,o 


1  -  f 


i,o 


if  a.  .  >0  and  t .  noninteger  variable 
*  >  J  .  J 


(—a  ,)  if  a,  .  <  0  and  t.  noninteger  variable 

1  t  J  >  J  J 


if  f.  ,  <  f,  and  t.  integer  variable 

*  1  >  J  1  j  o  J 


(f,  T) '  if  f,  ,  >  f.  and  t.  integer  variable 

1  j  J  1  *  J  1^0  J 


Equation  (3)  is  then  added  and  the  problem  is  remaximized. 
It  seems  sensible  to  use  the  dual  simplex  method  at  this  point 

i 

as  all  the  a  . ,  J  >1,  are  nonnegative,  and  there  is  only  one 
°  >  J 

I 

negative  element,  — f.  ,  in  the  0-column. 

If  the  dual  simplex  method  is  applied,  the  O-column  is 
decreased  lexicographically  at  the  nexi  step,  and  furthermore, 
denoting  by  double  primes  the  coefficients  after  the  next 
pivot  step  and  by  the  column  in  which  the  pivot  step  takes 
place,  we  have 


(9) 


al,o  <  ni,o 


I'  I 

a,  >  n,  +  1 
l,o  —  i,o 


if  a  >  0 

*  Jo 

if  a'  <  0 

l» 


f  f 

where  n,  is  the  integer  part  of  a,  ,  the  index  1  in  (9)  is 
i,o  i,o'  v  ' 

that  of  the  row  figuring  in  equations  (3)  through  (S). 
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To  cover  the  cases  when  t,  is  an  Integer  variable  we 

J°  * 

need  only  remember  that  in  this  case  the  f,  .  is  deduced  by 

*  Jo 

a  two— stage  process,  part  (ii)  of  which  is  exactly  the  same  as 

the  process  used  to  deduce  the  f?  .  when  t.  is  noninteger. 

,Jo  Jo 

Consequently  if  part  (i)  leaves  a^  j  unchanged,  either  (10) 

t 

or  (11)  holds  Just  as  above.  Part  (i)  will  have  a^  j  un¬ 
changed  only  if  either 


»  »  »  i 


al,J 

■  fi.r 

and 

fi,J 

< 

fi,o 

t 

i  t 

t 

t 

ai  >  J 

<  0,  -  f1#J  -  1, 

and 

fi,J 

> 

fi,o 

Otherwise  part  (i)  makes  a  change  which  results  in  a 
strictly  smaller  final  f *  j .  So  in  these  cases  we  have  the 
strict  inequalities 


ai,o  ^  ni,o 


if  a,  .  >  0 

1,Jo 


a.  >  n,  +1 
l,o  i,o 


if  a  <  o. 

'  Jo 


The  remaining  possibility,  a,  .  «  0,  can  not  occur  because 

.2 


0  implies  f 


1,J, 


0  and  so  f 


i,j  can  not.  be  the  pivot 
o 


o  '"O 
element.  Thus  (9)  holds  in  all  cases. 

Now  (9)  is  exactly  the  property  required  for  a  finiteness 
proof — l.e.,  a  proof  that  the  solution  Is  attained  in  a  finite 
number  of  steps — provided  that  the  objective  function  z  is  one 
of  the  Integer  variables.  To  see  this  we  arrange  the  original 


►  -  *  •  • 


;  P-1885 

■'*  , 

,  ■  •.  t 

1*) 

I 

equations  so  that  the  Integer  variables  on  the  left  In  (2) 
are  the  first  rowB  following  the  objective  function  z.  (This 
means  that  they  rank  higher  lexicographically  in  the  dual 
simplex  method.)  Given  property  (9)*  the  reasoning  in  the 
first  finitness  proof  in  [1]  (pp.  33-35)  now  goes  through 
unchanged.  Of  course  one  must  stop  now  on  attaining  the 
required  integer  values  in  the  0— column,  as  an  all— integer, 
matrix  is  not  generally  obtained. 

j 

4 


I 


I 


p-i  nr 


1. 


2. 


Go:i.  'r;/ Ralph  E.  ,  "At.  Al p.  a*  1  th:-.  1  •:*  1- 
Linear  Proprar.c  ,  Prir.cet  :  — 1  th 


,;'r  .1  to 

11'.:  n 


Pro.tect  Technical 


n 


•  r  - 


i  <  O  0  i  .  i.  /  ,  1 .  o 


Beale, /E.  M.  L.  ,  "A  r.ethoi  of  3  »lvisij;  Linear  Pro*;  rosining 
Problems  When  Some  :Xt t  Not  A.!.,  of  the  Variables  t 
Taka'  Integral  Value:*/'  S.oti 1  T-'cnr.  ique:;  Her. •.•arch 
Group,  Princeton  University  (:«anu.vcript) . 


II 

l) 


